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(57) Abstract 



A technique for the blind equalization of digital communications channel (12) relies on the iterative minimization of a cost function 
known as the J^divergence between a known or assumed probability density function (PDF) of the source (10) and an estimated PDF of 
a receiver decision (18) derived from the equalizer (16) by minimum^distance mapping. The J^divergence function is defined in terms of 
the Kullback-Leibler distance between the two PDFs. Minimization is achieved by continually updating both an equalizer tap coefficient 
vector and the estimated PDF of the decision output signal using a stochastic gradient algorithm applied to the J-divergence cost function 
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TITLE OF THE INVENTION 
Blind Adaptive Equalization Using Cost Function 



CROSS REFERENCE TO RELATED APPLICATIONS 
--Not Applicable — 

STATEMENT REGARDING FEDERALLY SPONSORED RESEARCH OR 

DEVELOPMENT 
— Not Applicable — 

BACKGROUND OF THE INVENTION 

The present invention is related to the field of 
digital communications, and more particularly to 
techniques for equalizing channel effects in digital 
communication systems . 

Digital communications suffers from a particular form 
of distortion known as intersymbol interference (ISI) . 
ISI has been recognized as the major obstacle to high 
speed data transmission over mobile radio channels. 
Digital communications systems use an operation known as 
"equalization" to * minimize ISI. This minimization is 
often achieved by minimizing a cost function which is a 
suitably chosen function of the data. 

There are generally two approaches to equalization: 
conventional equalization and "blind" equalization. In 
systems employing conventional equalization, a training 
sequence is transmitted over the channel prior to the 
transmission of any useful data. The training sequence is 
a data sequence that is a priori known to the receiver. 
The receiver uses the relationship between the known 
training sequence and the sequence it actually receives to 
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construct an approximation of the inverse transfer 
function for the channel. The equalizer is then 

configured to use the inverse transfer function and 
thereby induce minimal ISI. 

Conventional equalization is problematic in some 
communication systems, such as mobile and multi-point 
communications systems, because the training sequences use 
up scarce bandwidth resources that could otherwise be used 
to transmit useful data. Such systems therefore often use 
blind equalization, which is a form of equalization that 
does not require the use of a training sequence. 

There have been several approaches to the problem of 
blind equalization including a popular technique known as 
the Godard algorithm. These algorithms generally employ 
15 cost functions that measure the expected value of a 

function of the equalizer output. For example, the Godard 
algorithm uses a functional called the dispersion of order 
p (where p is a positive integer) as the cost function. 

It is desirable to improve the ability of digital 
20 communications systems to minimize ISI, including 

communications systems employing blind equalization. 
Systems achieving such reduced ISI are capable of 
achieving reduced data error rates at prevailing data 
transmission rates, or can obtain higher data transmission 
25 rates without sacrificing data integrity, in order to 

obtain better overall system performance. 

BRIEF SUMMARY OF THE INVENTION 
A blind equalization method is disclosed that 
30 achieves improved ISI performance over prior blind 

equalization techniques. The disclosed method uses a cost 
function that measures dissimilarity between an assumed or 
known probability density function (PDF) of a source data 
signal and a continually-estimated PDF of an equalized 
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data signal recovered by a decision function coupled to 
the equalizer output. The measure of dissimilarity used 
is akin to a "distance" as that term is used in topology 
or communications theory. One such cost function, termed 
the J-divergence of the two PDFs, measures the cross 
entropy between two PDFs. A set of tap coefficients used 
to realize the equalizer, along with the estimated PDF of 
the equalized data signal, are continually updated in a 
manner tending to minimize the J-divergence, so that the 
statistics of the equalized signal are made to closely 
match those of the source signal. A stochastic gradient 
algorithm for performing this minimizing updating is 
disclosed. The disclosed equalization technique generally 
converges to a lower level of ISI than do prior techniques 
such as the Godard algorithm. 

BRIEF DESCRIPTION OF THE SEVERAL VIEWS OF THE DRAWING 

An embodiment of the invention is described below 
with respect to the accompanying drawing, in which: 

Figure 1 is a block diagram of an exemplary digital 
communications system in accordance with the principles of 
the present invention; 

Figure 2 is a block diagram of a receiver in the 
communications system of Figure 1; 

Figure 3 is a map of data elements stored in memory 
in the receiver of Figure 2 during operation thereof; and 

Figure 4 is a flow diagram of the operation of the 
receiver of Figure 2. 

DETAILED DESCRIPTION OF THE INVENTION 
In Figure 1 a source 10 such as a modem emits a 
source signal {x k } that is transmitted over a channel 12. 
The signal (yk) received from the channel is provided to a 
receiver 14, which as shown includes an equalizer 16 and a 
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decision function 18. The output of the equalizer is 
referred to as {Zk}, and the output of the decision 
function is referred to as {z k }. 

In general, the signal {x k } is an amplitude-modulated 
digital communications signal, either pulse- or 
quadrature-amplitude modulated. If the signal {x k } is 
pulse-amplitude modulated, it is a real-valued M-ary 
signal and is known as an M-PAM signal. An M-PAM signal 
{Xk} takes on signalling values that are symbols in an M- 
ary symbol alphabet A given by: 

A = {-(M-l)d, ... -3d, -d, d, 3d, ... (M-l)d}, 

where M is the number of discrete levels in the alphabet 
and 2d is the amplitude difference between adjacent 
levels . 

If {Xk} is quadrature-amplitude modulated, it contains 
real and imaginary M-ary component signals and is known as 
an M-QAM signal. The M-QAM case is not described in 
detail herein; however, the disclosed techniques upon 
suitable modification are likewise applicable to M-QAM 
systems . 

The symbols appearing in the signal {Xk) are a priori 
known or assumed to be distributed according to a 
probability density function (PDF) p x ( ) . In one case for 
which results are given herein, the samples x k of the 
signal {x k } are assumed to be statistically independent of 
each other and to be equally likely to be any of the M 
possible symbols in A. In this special case the samples x k 
are said to be "independent and identically distributed" 
or i.i.d. random variables. However, the techniques 
described herein are generally applicable to source 
signals having different PDFs. 

The channel 12 is assumed to be a linear finite 
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impulse ( FIR) response filter. The equalizer 16 is 

realized as a FIR filter with adjustable coefficients. 
The decision function 18 resolves each sample Zk of the 
equalizer output signal {z k } to the closest corresponding 
symbol from the alphabet A using a minimum-distance 
function. The decision output signal {£*} is available to 
a data recipient not shown in Figure 1, and is also fed 
back to the equalizer 16 for use in the adaptive 
equalization algorithm as described below. 

Figure 2 shows a block diagram of the equalizer 16 of 
Figure 1. A processor 20 is adapted to receive the signal 
{y k } and to output the equalized data signal (f k) • The 
processor 20 may be a general purpose digital signal 
processor, or other suitable processing means such as are 
known in the art. The equalizer 16 also uses memory 22 to 
store various parameters, signals, and ' intermediate 
results during execution of the equalization algorithm. 

Figure 3 illustrates some of the key data components 
appearing in memory 22. A first component K (23) is used 
during initialization as described below. Yk (24) is a 
regressor of inputs to the equalizer 16, and is expressed 
as : 

Yk = [yk+N ... y k ... yk-N] T 

where [ ] T denotes vector transposition. 

The component 8 k (26) is a vector of tap coefficients 
used in the equalizer 16, and 6 k+1 (28) is a tap 
coefficient vector being calculated during each sampling 
interval for use in the next sampling interval. These 
vectors are expressed as: 

9 = [ 6-n • • • 9o ... ®n] 

Components 30 and 32 represent current and next 
values, respectively, of an estimated PDF of the signal 
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|z k ], these PDFs being denoted />,*() and /». ()• The 
characteristics of these PDFs are described in greater 
detail below. 

The Cost Function 

The equalizer 16 employs a cost function based on a 
value known as the Kullback-Leibler (KL) distance between 
two PDFs pi and p 2 . This value is denoted KL(pi, P2) and is 
given by the expression: 

KL(P I ,P2) = E,\^ < -^ 

where Ei{ } indicates expectation with respect to pi ( ) . 

The KL distance is used to construct a function 
called the J-divergsnce having topological properties, in 
particular the property of symmetry, that make it suitable 
for use in the manner described herein. The J-divergence 
is defined as: 

Jdiv( p l ,p 2 ) = KL(p 1 .P 2 ) + KL (P2-P l ) 
The' cost function used in the illustrated embodiment 
is denoted J(©), and is generally given by: 

J(0) = Jdiv( Pi ,p x ) 

In the case where {x k } is an M-PAM, i.i.d. signal, 
J(G) is given by: 



J(0) = J \n[^Af Pi (U) - pMl 



The Stochastic Gradient Algorithm 

The equalizer 16 employs a stochastic gradient 
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algorithm in order to minimize the J-divergence between 
the PDFs px() and p, ( ) . The general form of this algorithm 
used in the equalizer 16 is as follows: 

VAR k+1 = VAR k - rVvAR W 



where V is the gradient operator and y is the iteration 
step size. The equalizer 16 employs the stochastic 
gradient algorithm in two ways: (1) to update the tap 
coefficient vector e, and (2) to update the PDF p s () . In 
each use of the algorithm the variable being updated is 
substituted for VAR in the above equation. It can be shown 
that, for the case of {x k } being M-PAM and i.i.d., the 
algorithm for each use reduces to the following: 



1 + ln 



Pj(Zk) > 
,Px(zk)> 



Px(Zk) 
Pz(Zk) 



5p,(zk) 



3zk 



7 + ln 



( p,(z k A P x (zJ 
pjzk)) Pi(zk) 



where y and a are the step sizes of the respective 
updates . 

Figure 4 shows the flow of blind adaptive 
equalization processing carried out by the processor 20 of 
Figure 2. In step 40 the equalizer 16 is initialized as 
an all-pass filter. The order of the equalizer is given 
as (2N+1), and thus the initial equalizer tap coefficient 
vector © is : 

[0 ... 0 1 0 ... 0] 
where the single "1" is the (N+l) th element of the vector. 
This equalizer configuration sets the signal {z k } equal to 
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the signal {yk} during an initial period. 

In step 42, the process waits for an initial period 
of K samples. During this initial period, an initial 
regressor Yk is collected in the equalizer 16, and the 
first K samples of are collected. 

In step 44, the first K samples of {z k ) are used to 
create an initial estimate of the PDF p 2 ( ) . This PDF is 
estimated by generating a histogram from the initial 
samples or by fitting a gaussian kernel to the samples, and 
then normalizing the resulting PDF over the finite support. 
The normalized PDF is used as the initial estimate of the 

PDF Pi () . 

At step 46 of Figure 4, an index variable k is set 
equal to K+l, and then the process enters a loop of steps 
48-56 which are repeated for each new sample y k of the 
received data signal. 

In step 48 an equalizer output value z k is calculated 
from the regressor Yk and the vector © k . This calculation 
is a FIR filter as follows: 

As shown, the data output symbols { z *} emerging from the 
receiver 14 are created by the continued iterations of 
step 48 in conjunction with the decision function 18 of 
Figure 3. 

In step 52, the next tap coefficient vector © k+1 (28) 
is calculated using the J-divergence function and the 
stochastic gradient algorithm as described above. 

In step 54, the next estimated PDF /? 5 k+1 (z k ) (32) is 
calculated also using the J-divergence function and the 
stochastic gradient algorithm as described above. 
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10 



15 



in step 56, the PDF pA) and the vector 6 are updated 
by substituting the new values (32) and 0 M (28) 

respectively for P * (30) and 6* (26). Then the index 
.variable k is incremented, and the top of the loop (step 

48) is re-entered. 

While the invention has been described with reference 
to an embodiment in which the source signal {x k } is M-PAM, 
it can be readily shown that the blind equalization method 
can also be used with a quadrature-ampiitude-modulated (M- 
QAM) source signal. Also other cost functions can be 
employed, one such alternative being the mean square 
function. in addition, it will be appreciated by those 
skilled in the art that other modifications to and 
variations of the disclosed blind equalization method are 
possible without departing from the innovative concepts 
contained herein. Accordingly the invention herein 

disclosed is not to be viewed as limited except as by the 
scope and spirit of the appended claims below. 
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CLAIMS 

1. An equalization method, comprising the steps of: 

(i) generating an equalizer output signal {z k } from a 
channel output signal {y*} and a series of updates of an 
equalizer tap coefficient vector e, the signal {y k } being 
obtained from a communications channel having as input a 
source signal {x k } having symbols drawn from an alphabet A 
either assumed or known to be distributed according to a 
predetermined probability density function (PDF) p x (); 

(ii) generating a decision output signal { z k ) from 
che signal {z k } based on the proximity of each sampled 
value z k to a corresponding symbol in A; 

(iii) continually updating an estimated PDF Pi ( ) 
according to which the values of the signal { z y.) are 
estimated to be distributed among the symbols of A, the 
PDF pA) being updated in a manner tending to minimize a 
cost function, that measures dissimilarity between the PDF 
p x ( ) and the PDF /> f ( ) ; and 

(iv) continually updating the vector 9 in a manner 
also tending to minimize the cost function. 

2. A method according to claim 1, wherein the cost 
function is the J-divergence of the PDFs p-A) and p f O- 

3. A method according to claim 1, wherein each of the 
updating steps comprises the step of performing a 
stochastic gradient algorithm on the cost function with 
respect to the variable being updated. 

4. A method according to claim 1, further comprising the 
steps of: 

setting the vector 6 to an initial all-pass value 
such that the signal {z k } is equal to the signal {y k } 



WO 99/55047 



PCT/US99/08423 



- 11 - 



throughout an initialization period; 

retaining the samples of the signal {z k } generated 
from the signal {z k } during the initialization period; and 

calculating an initial value of the PDF Pi () at the 
end of the initialization period based on the retained 
samples of. the signal ffk). 

5. A method according to claim 4, wherein the step of 
calculating p ; ( ) comprises the steps of: 

constructing a PDF from the retained samples of the 

signal {z k }; and 

normalizing the constructed PDF. 

6. A method according to claim 1, wherein the source 
signal {x k } is an M-ary pulse-amplitude-modulated signal 
(M-PAM) . 

7. A method of equalizing a channel over which a source 
signal {x k } is transmitted, comprising the steps of: 

initializing an equalizer tap coefficient vector e< to 
an all-pass value so that an equalizer output signal {z k } 
is initially equal to a channel output signal {y k } provided 
as input to the equalizer; 

mapping the signal {z k } to a decision output signal 
tz k ) the samples of which are drawn from a symbol alphabet 
A from which the samples of the signal {x k } are also drawn; 

during an initial period of K samples, collecting an 
initial regressor Y k of the first K samples of {y k } and 
also collecting the first K samples of the signal {z k }; 

calculating an initial value of an estimated PDF pA) 
from the collected samples of {z k }, the estimated PDF pA) 
describing the distribution of samples of the signal {z k } 
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over the alphabet A; and 

repeating the following steps for each new sample y k 
of the received data signal: 

(i) updating the regressor Yk to include the new 
sample yk; 

(ii) calculating an equalizer output value Zk 
from the regressor Y k and the vector © k ; 

(iii) calculating a next tap coefficient vector 
9 k+1 using a stochastic gradient algorithm to minimize 
a J-divergence function of the PDF /? f k ( ) and a PDF 
p x ( ) describing the distribution of samples of the 
signal {x k } over the alphabet A; 

(iv) calculating a next estimated PDF /? £ k+1 ( ) 
using the stochastic gradient algorithm to minimize 
the J-divergence function of the PDFs p x ( ) and () ; 
and 

(v) updating the PDF p, k {) and the vector 8 k to 
the new values p s k+1 and 8 k+1 , respectively- 
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